Decision Theoretic Approaches to Experiment Design and External Validity
نویسندگان
چکیده
منابع مشابه
Decision Theoretic Approaches to Experiment Design and External Validity∗
A modern, decision-theoretic framework can help clarify important practical questions of experimental design. Building on our recent work, this chapter begins by summarizing our framework for understanding the goals of experimenters, and applying this to re-randomization. We then use this framework to shed light on questions related to experimental registries, pre-analysis plans, and most impor...
متن کاملAn Information-Theoretic External Cluster-Validity Measure
In this paper we propose a measure of sim ilarity /association between two partitions of a set of objects. Our motivation is the desire to use the measure to characterize the quality or accuracy of clustering algorithms by some how comparing the clusters they produce with "ground truth" consisting of classes as signed by manual means or some other means in whose veracity there is confidence....
متن کاملHow to Examine External Validity Within an Experiment∗
A fundamental concern for researchers who design and analyze experiments is that the experimental result might not be externally valid in another context. Researchers have traditionally attempted to assess external validity by comparing data from an experiment to other data. In this essay, I use insights from my recent work to show researchers how to begin the examination of external validity i...
متن کاملA Decision Theoretic Approach to Shopbot Design
Shopbots are software agents that automatically query a large number of vendors for price and availability of products. They are the primary tools for comparison-shopping on the Internet. Despite their apparent usefulness, shopbots impose considerable costs on their users because of the manner in which they make their operational decisions. Specifically, search tends to be slow resulting in hig...
متن کاملInformation and Decision Theoretic Approaches to Problems in Active Diagnosis
Information and Decision Theoretic Approaches to Problems in Active Diagnosis by Gowtham Bellala Chair: Clayton D. Scott In applications such as active learning or disease/fault diagnosis, one often encounters the problem of identifying an unknown object while minimizing the number of “yes” or “no” questions (queries) posed about that object. This problem has been commonly referred to as object...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: SSRN Electronic Journal
سال: 2016
ISSN: 1556-5068
DOI: 10.2139/ssrn.2770140